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1. ) The document NPSNET as cited in the description on page 4, lines 8-10 and 

discussed on page 4, lines 7-26 is considered to represent the closest prior art. 

In the light of said document, the objective technical problem would be "how to link 
avatar movement to zone awareness". 

The solution as specified in independent claims 1,12, and 24 provides the 
advantage of reducing the amount of information to be transmitted to the systems 
corresponding to the avatars in order to maintain a common view between them. 

Appendix to Section VII 

2. ) The features of the claims are not provided with reference signs placed in 

parentheses (Rule 6.2(b) PCT). 

3. ) The description is not in conformity with the claims as required by Rule 5.1(a)(iii) 
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CLAIMS 

1 . A terminal for providing a virtual environment interface to server means 

which maintains said virtual environment as a plurality of zones, comprising: 
5 a client providing a user interface to the virtual environment to allow a user 

to control an avatar in the virtual environment; and 

apparatus for estimating the likelihood of said avatar, under the control of 

said user in the virtual environment, moving within a predetermined range of a 

boundary, the apparatus comprising: 
1 0 recording means for recording the position of the avatar at intervals to obtain 

movement data; 

means for storing data as to the relative frequency of occurrence of different 

categories of said movement; 

means arranged to read, from the stored data, frequency data for categories 
15 of movement such as would correspond to a potential movement of the avatar from 
its current position into a position within said predetermined range of said boundary; 

wherein the client is arranged to obtain information from said server means 
about the status of the adjacent zone only when the likelihood of the avatar movmg 
within the predetermined range of the boundary of said adjacent zone is above a 
20 tiireshoid. 

2. A terminal according to claim 1 wherein said threshold is determined in 
dependence upon a cost function. 

25 3 A terminal according to claim 1 or 2 wherein said threshold is determined in 

dependence upon the amount of communication traffic and/or the time taken for the 
communication with the server means. 

4. A terminal according to any preceding claim wherein said means for storing 
30 data is arranged to discard data relating to movement after a set period of time. 
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5, A terminal according to any preceding claim wherein said recording means is 
adapted to record the position of said avatar at regular intervals of time in said virtual 
environment. 

5 6. A terminal according to any preceding claim wherein the potential movement 
of the avatar takes into consideration obstructions to the movement of said avatar 
within said virtual environment. 



7. A terminal according to any preceding claim wherein said predetermined 
10 range is dependent upon a range of awareness of said avatar within which said 

avatar can experience the virtual environment. 

8. A terminal according to any one of claims 1 to 7 wherein said categories of 
movement are determined by run lengths. 

15 

9. A terminal according to any one of claims 1 to 7 wherein said categories of 
movement are determined by run lengths within a predefined corridor. 

10. A terminal according to any one of claims 1 to 7 wherein said categories of 
20 movement are determined by the movement of said avatar into areas around said 

avatar. 

11. A terminal according to any one of claims 1 to 7 wherein said categories of 
movement are determined by directions and distances of movement of said avatar. 

25 

1 2. Apparatus for estimating the likelihood of an avatar, under the control of a 
user in a virtual environment, moving within a predetermined range of a boundary, 
the apparatus comprising: 

recording means for recording the position of the avatar at intervals to obtain 
30 movement data; 

means for storing data as to the relative frequency of occurrence of different 
categories of said movement; and 
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means arranged to read, from the stored data, frequency data for categories 
of movement such as would correspond to a potential movement of the avatar from 
Its current position into a position within said predetermined range of said boundary. 

5 13. Apparatus according to claim 12 wherein said means for storing data is 
arranged to discard data relating to movement after a set period of time. 

14.. Apparatus according to claims 12 or 13 wherein said recording means is 
adapted to record the position of said avatar at regular intervals of time in said virtual 
1 0 environment. 



15. Apparatus according to any one of claims 12 to 14 wherein the potential 
movement of the avatar takes into consideration obstructions to the movement of 
said avatar within said virtual environment. 

15 

16. Apparatus according to any one of claims 12 to 15 wherein said 
predetermined range is dependent upon a range of awareness of said avatar within 
which said avatar can experience the virtual environment. 

20 17. Apparatus according to any one of claims 12 to 16 wherein said categories 
of movement are determined by run lengths. 



18. Apparatus according to any one of claims 12 to 16 wherein said categories 
of movement are determined by run lengths within a predefined corridor. 

25 

19. Apparatus according to any one of claims 1 2 to 16 wherein said categories 
of movement are determined by the movement of said avatar into areas around said 
avatar. 



30 20. Apparatus according to any one of claims 1 2 to 16 wherein said categories 
of movement are determined by directions and distances of movement of said avatar. 
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21 - A system for providing a distributed virtual environment comprising: 

one or more servers for maintaining said virtual environment as a plurality of 

zones; 

a client for providing a user interface to the virtual environment to allow a 
5 user to control an avatar in the virtual environment; and 

apparatus for predicting the likelihood of said avatar moving within a 
predetermined range of a boundary of a zone according to any one of claims 1 2 to 
20; 

wherein said client is arranged to communicate with the one or more servers 
10 to obtain information on the status of one or more further zones when the likelihood 
of the avatar moving within a predetermined range of the boundary of said one or 
more further zones is above a threshold. 

22. A system according to claim 21 wherein said threshold is determined in 
1 5 dependence upon a cost function. 

23. A system according to claim 21 or 22 wherein said threshold is determined 
in dependence upon the amount of communication traffic and/or the time taken for 
the communication with the one or more servers. 

24. A method of operating a computer terminal to provide a virtual environment 
interface to server means which maintain said virtual environment as a plurality of 
zones, the method comprising; 

controlling a client which provides a user interface to the virtual environment 
to allow a user to control an avatar in the virtual environment; and 

estimating the likelihood of said avatar, under the control of said user in a 
virtual environment, moving within a predetermined range of a boundary, the method 
for estimating said likelihood comprising: 

recording the position of the avatar at intervals to obtain movement data; 
storing data as to the relative frequency of occurrence of different categories 
of said movement; 
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reading, from the stored data, frequency data for categories of movement 
such as would correspond to a potential movement of the avatar from its current 
position into a position within said predetermined range of said boundary; 

instructing the client to obtain information from said server means about the 
5 status of an adjacent zone only when the likelihood of the avatar moving within the 
predetermined range of the boundary of said adjacent zone is above a threshold. 

25, A method according to claim 24 wherein said threshold is determined in 
dependence upon the amount of communication traffic and/or the time taken for the 

1 0 communication with the server means. 

26. A method according to claim 24 wherein stored movement data is discarded 
after a set period of time, 

15 27. A storage medium storing instructions for controlling a computer to carry out 
the method of any one of claims of any one of claims 24 to 26. 

28. A signal carrying computer-impiementable instructions for controlling a 
computer to carry out the method of any one of claims 24 to 26. 
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1- Apparatus for D^Pr^^^^-• 

Predicting the likelihood of an ^^.r 
nr^HQ>- 4-1- avatar 
under the control of a user in • 

user m a virtual environment 
nioving within a predeter-n, - ^ ^onment 

predetermined range of a boundary, the 
apparatus comprising: 

monitoring means fr.^ 

for monitoring movement of said 
avatar in said virtual ^ ■ 

so as to ■ for a period of time 

so as to obtain movement data; 

model means for • - 

tor determining a model of avatar 
movement usina th^ ^varar 
sing the movement data; and 

prediction me^nc -p^ 
said a . predicting the likelihood of 

said avatar moving within o.-^ 

said h H predetermined range of 

said boundary using said model. 

2. Apparatus according to claim i 

y ^o claim 1 wherein said model 
means is adapted i-o h ^ moaei 
Pted to determine a dynamic model using only 
movement monitored within . 

within a recent time period. 

3- Apparatus according to claim i 

saiH • ""^^^"^ 2 wherein 

said monitoring means is . ^ 

Of said a . '° position 

or said avatar with ^^nn^ - 

time in said virtual environment. 

Apparatus accord ir,^ 

said o "''"^ " P-«ciin, clai. Wherein 

said prediction means i= 

P.ediction .a.in, in J '"'^ '° ^"^"^ 

Virtual e ■ -thin said 

Virtual environment which . • 

-hich restrict movement of said 
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avatar. 



5 



10 



5- Apparatus accordincr 

^ preceding claim wherein 

saxd prediction nieans is adao^ ^ 

prediction taking into ^ ^^^^ 

Virtual e • —deration features within said 

vxrtual environment which - 

"""^ ^'^^ "^^^^^^ Of said 
avatar to experience the v.r-i- t 

tne virtual environment. 

6- Apparatus accordinrr 

said w preceding claim wherein 

said predetermined ranoe -i ^ 

range is dependent upon a range of 
awareness of saiH =. ^ 

sa.d avatar „ithi„ „hi,h said avata. can 
experience the virtual - 

means is h — "--t, and said prediction 

means xs adapted to r^o>-^=^ 

con H '"'^ prediction taking into 

consideration features within said virtual en • 
15 Which restrict the range of a -vironment 

^nge of awareness of said avatar. 

7- Apparatus accordina to 

said preceding claim wherein 

said prediction means is ^ri.^^ ^ 

Of said a . '° " liicelihood 

Of said avatar moving within 

20 said bo H Predetermined range of 

said boundary within ^ ^ ^ ^ 
y rthm a predetermined period of time. 

8- Apparatus accordinrr i-r. , 

said mo •^ • Preceding claim wherein 

said monitoring means is adapted to provide time 

Of the position of said " 

25 ""^ ""^^ ".eans is 

25 adapted to determine ^ h • 

rmme a dynamic model which i = 

every n- sample from said • 

monitoring .eans using the n 

most r^non^ ^ i ^ ^iie n 

j:^ecent samples ^r>^ i. • , 

and which is formed usin 
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plurality m of most recent s^^c: ^ 

ecent sets of n samples from said 

monitoring means. 



9- Apparatus accordino to 

ing to any preceding claim wherein 
said model means is adapted to h ^ 

aapted to determine said model as 
set of values for dir-o^4-- 

i:or directions and distances of 

i.ant,es or movement 

of said avatar. 



10. Apparatus accordino i-r, = 

raxng to any one of claims i to 8 

wherein said model mean^ ■; ^ ^ 

means is adapted to determine said 

model as valup^c; -fr^^ ^ 

, ' -atar indicating 

the likelihood of ssiH *. 

Of said avatar moving into said areas. 

11- Apparatus accordino +-o 

, °f claims 1 to 8 

wherein said model mean=; = ^ 

means is adapted to determine said 
model as values for- r-,i„ t 

for run lengths indicating the likelihood 
ot said avatar movina in ^ h • 

ng m a direction for a particular 

length . 



12. Apparatus accordino to ^r, 

aing to any one of claims l to 8 
wherein said model meanc; ^ ^ 

^^"^ ^= adapted to determine said 
model as values for t-,,,, i 

run lengths within a corridor 
o-ndicating the likelihood, of said av.^. 

or said avatar moving within 
a corridor in a direct i or, 
25 , ^ erection for a particular corridor 

length. 
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environment, the apparatuc, ■ ■ 

fforacus comprising: 

one or more servg^r-c -f^ 

servers for maintaining said virtual 

environment as a Dlnr-ai,-<- 

pj-urality of zones; 

^ client for nr-oi,-,-^- 

providing a user interface to the 

virtual environment to aUow a user to control an avatar 
- the Virtual enviro™ent, „herein said client is 

adapted to communicate 

icate with one or more of the servers 
only with regard to on^ ^ 

g one or more zones in the proximity 

Of said avatar; and 

apparatus for predicting the likelihood of said 
avatar .oving „ithin a predetermined range of a boundary 
Of a .one according to any one of claims 1 to 12; 

wherein said clif^rn- ^ j 

a Client IS adapted to communicate with 
one or more of the or e;=.r-h 

or each servers to obtain information 
on the status of one r.r- 

one or more further zones when the 
likelihood of the fi\r^i-=.-^ 

avatar moving within a predetermined 
range of the boundary of ^^in 

of said one or more further zones 

IS above a threshold. 

14. A system according to rl^i'm u 

g to claim 13 wherein said client 

13 adapted to co^unicate with said one or more servers 
- Obtain information on the status of one or more 

further zones when the liv<::.i u ^ 

the likelihood of the avatar moving 

withm a predetermine ranae of hh^ k 

range of the boundary of said one 

or more further zone<? = 

^ones IS above a threshold and in 

dependence upon at least one of th. 

one ot the amount of 

communication traffic 

"ic, the time taken for the 
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communication with the 



processing power required as 



communication , 



or each servers, and the 
a result of the 



15. A client for use wn-u 

use With a computer system for 

providing a distri 

aistributed virtual environment which 

includes one or more server-.; fr.^ ^= • ^ • • 

servers for maintaining said virtual 

environment as a plurality of zones th. 

J v^-L zones, the apparatus 

comprising: 

interface „eans for providing a user interface to 
the Virtual enviror^ent to allow a user to control an 
avatar in the virtual enviror^ent wherein the interface 
means is adapted to co^unication with one or ™ore of the 
or each servers only with regard to a number of .ones in 
the proximity of said avatar; and 

apparatus for predicting the litelihood of said 

avatar movino within r^>-^^ ^ 

g itnrn a predetermined range of a boundary 

Of a zone according to any one of claims 1 to 12; 

"herein the said interface means is adapted to 
communication with one or more of the or each servers 
to Obtain information on the status of one or more 
further .ones when the likelihood of the avatar moving 
wrthin a predetermined range of the boundary of said one 

or more further a zone^c; 

zones IS above a threshold. 

16. A client according to claim ^^ 

y T^o Claim 15 wherein said 

interface means is adan^oH 

adapted to communication with said one 
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or more servers to obtain 

^taxn xnformation on the status of 
one or more further -^^^ 

rther zones when the likelihood of the 
avatar moving within a prede^^^ • 

Of said o P-edetermxne range of the boundary 

or said one or more fnr-^K^ 

and in d . ^"'^^^ ^ threshold 

and xn dependence upon ai- i== ^ 

^ ^^^^^ °f the amount of 

communication traffic th^ 

ic, the time taken for the 
communication with the . 

or each servers, and the 
processing power required as a 

^ i«a as a result of the 

communication. 

17. A method of Drpdir-t-,- 

create. . .J ^ ^"'"^ e„...o™.„. 

a computer sv<;i-am 

^ ^ system moving within a 

.o..o„.„, 3.ep. p„,_,, ^^^^ ^^^^^^^^ 

monitoring movement of s;,iH . ^ 

^^^"^ said virtual 

environment for a period of time; 

determining a model of 

Of avatar movement using the 

monitored movement; and 

predicting the liu^i-i- 
wxthxn said predeter-m i r.^^ 

= aid H , "nge ot .aid boundary using 

said model. 



18. A method according to cl. 

^rmined is a dynamic model usina oni 
monitored within a movement 

wxunin a recent ti 



IS deter"^-" " 



nie period 



• 
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19. A method according to claim t7 

y Claim 17 or claim 18 wherein 
the movement of said = 

said avatar is monitored by monitoring 
the position of said avsi-^v- 

ici avatar with time in said virtual 

environment. 

20. A method accordina rr. 

^amg to any one of claims 17 to 19 

wherein said r)r*=H r^-f- • 

prediction is preformed taking into 

consideration feature<=: ^n-u- 

eatures withm said virtual environment 

Which restrict movement of said avatar. 



21. A method accordino to ^r..r ^ 

uing to any one of claims 17 to 20 

wherein said Dr<=^ri i ■ 

prediction is performed taking into 

consideration featurec; ^n.-u- 

tares within said virtual environment 

which restrict the abilitv of 

Diiity of said avatar to experience 
15 the virtual environment. 



22. A method according to any one of claims 17 to 21 
Wherein said predetermined range is dependent upon a 

range of awareness of cs^in = 

ot said avatar within which said 

avatar can experience the virtual environment, and said 
prediction is performed taking into consideration 
features within said victual environment which restrict 



the range of awa 



reness 



25 23. A method accor-Hiorr 

ccording to any one of claims 17 to 22 

wherein said predicting <^ 

P diction IS a prediction of a likelihood 
OE said avatar moving within c.^.-^ 

y xthin said predetermined range of 
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said boundary within a predetermi 



ned period of t 



24. A method accordina i-r. 

rdmg to any one of claims 17 to 2^ 

wherein the monitoring. to 23 

5 . "^torxng provides time samples of the 

5 position of said avatar in 

""-^ Virtual environment and 
sa.d model is determined as a dvn. • 

, ""^^'^ "^^'^^ - -3t recent samples 

and whxch is formed usina am i- 

sets Of n , plurality m of most recent 

sets of n samples. 

10 

25. A method accordina to 
wherexn said model is d^^^ ■ 

direct- determined as set of values for 

directions and distances of ™ 

nces of movement of said avatar. 

15 26. A method accordina tn .r. 

^ °f claims 17 to 24 

wherein said model is - 

^s determined as values for areas 
around said avatar i.,H- 

-tar indicating the likelihood of said 
avatar moving i„to said areas. 

20 27. A method accordina to 

ing to any one of claims 17 to 24 
wherein said model is d^^ ■ ^ to 24 

determined as values for run 
lengths indicatina th^ t, , 

ting the likelihood of said av^t-. 
in a ^- . ^<i-La avatar moving 

in a direction for ^ ^ - 

^or a particular length. 

25 28. A method accordina to . 

. ^ °f ^l-inis 17 to 24 

wherein said model is riot- ■ ' to 24 

IS determined as run lenahhc • 
- corridor indicating th , • u 

^ l^Jcelihood Of said avatar 
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moving within a corridor in . h • 

or in a direction for a particular 
corridor length. rticular 

29. A method of usinrr 
5 H- computer system to provide a 

5 distributed virtual cr. ■ Provide a 

steps ^^^^^^^ 

°' — using one or „ore servers; 
controlling a clieni- i- 

10 the virt 1 " "^"^ interface to 

the virtual environment to ali^ 

. . ^ "^^^ to control an 

avatar in the virtual «^ • 

environment, wherein said client 
communicates with one or- client 

"^'^ °' --^y With 

regard to one or more zones in i-h. 

proximity of avatar; 
predicting the likelihood of said . . 

^5 Within predetermined range of . '^^'^^ 

^ange of a boundary of a further 
zone using the method of further 

nod of any one of claims 17 to 28- 
wherein said clie.ni- ^ 

""^-"icates With said one or 

more servers to obtain ^ 

f information on the status of said 

further zone when th^ , 

nen the likelihood of the av^i- = 
20 within a predeterm" . ""^"^"^ 

predetermined range of the boundary of said 
further zone is above a threshold. 

II \ - - Wherein the 

communication with saiH 

25 d. H °" further 

^5 dependent upon a cost f - 

cost function associated with ^ho 
potential degradation in . 

in performance experienced by a 



user 
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31. A method accordino i-^ 

^ ^^^i'" 30 wherein the 

communication is f„r-+-K 

<^ependent upon at least one of 
the amount of communication traffic 

tho ■ traffic, the time taken for 

the communication with s^iH 

^th said servers, and the process," 
power required as ^ , Processing 

Mixiiea as a result of= +-v,^ 

"J-i: ot the communication. 

32. A method of nro^i^,- 

Claim 29 th ^ ^^^-t in the method of 

Claim 29, the method comprising: 

providing a user ^ 

user interface to i-ho 

une viT-1-iisi 

environment to allow ^ irtuai 

Virtual e ■ " " - ^-^^ 

Virtual environment, wherein i-v, 

con,n, • "^^^ interface only 

communications with one 

°' With 
regard to a number of zones in th^ 

avatar; proximity of said 

predicting the likelihood of said .v . 
. avatar movina 

withm a predetermined ranae of k 

a range of a boundary of a further 
zone using the method of further 

°f any one of claims 17 to 28 
wherein the user ir,+-^ * ' 

user interface communicates with said 
one or more server*; i- w 

Of saia f information on the .tatus 

- 3a.a .„t.e. .one „.en tHe iiKeiiKoo. o. the avata. 

moving within a predet*=^n, • ^ 

f-teaetermined ranoo of w 
^ . . ^ range of the boundary of 

said further zone is 

is above a threshold. 

33. A method acr-ov-n,- 

according to claim 32 wherein the 



more servers is further 



communication with c;^iw 

wicn said one or 

dependent upon a cos^ f 

cost function associated with the 
potential degradation in f 

in performance experienced by a 
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user . 



34 



5 
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A method according to r-l^im 7 7 u 

-Liiy t:o Claim 33 wherein the 

communication is further dependent upon at least one of 
the amount of communication traffic, the time taken for 

the communication wit-h ca,^ 

-Lon with said servers, and the processing 

power required as a result of the communication. 

35. A storage medium storing instructions for 
controlling a computer to carry out the method of any one 
of claims 17 to 34, 



36. A signal carrying computer implementable 
instructions for controlling a computer to carry out the 
15 method of any one of claims 17 to 34. 
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PREDICTING AVATAR MOVEMENT IN A DISTRIBUTED 
VIRTUAL ENVIRONMENT 
The present invention generally relates to a 
distributed virtual environment in which the movement of 
an avatar controlled by a user is predicted. In 
particular, the present invention relates to a 
distributed virtual environment which is divided into 
zones wherein the likelihood of an avatar moving within 
a predetermined range of a zone boundary is predicted. 

A virtual environment is a computer model of a 
three-dimensional space. At their most basic virtual 
environment applications allow a user to specify a 
"camera" location from which they wish to view the space. 
The application then renders the appropriate view of the 
environment from this location and presents it to the 
user on a monitor of the computer running the 
application. With this degree of functionality virtual 
environments can be used in a wide variety of 
visualisation applications e.g. taking a walk around a 
building not yet constructed. 

Most virtual environment applications are however 
considerably more sophisticated than this and offer both 
an environment populated with objects (termed entities) 
which possess both a state and behaviour, and a means for 
the user to interact with these entities . 

Virtual environments have many applications. One 
which has become particularly popular is in the field of 
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computer games. Games such as Doom and Quake allow a 
user to control an entity to interact with the virtual 
environment modifying the state of entities within the 
virtual environment . 
5 A further development of the virtual environment 

concept is the shared virtual environment. This involves 
a number of users, each with their own copy of the 
relevant virtual environment application (termed a 
client) experiencing a three dimensional space which is 

10 common to them all. Each user not only perceives the 
results of their interactions with the entities but also 
the results of other users interactions. To represent 
the location of a user in a shared virtual environment 
a special case of entity, known as an avatar is employed. 

15 This provides a visual representation on all of the 
clients as to where a particular user is viewing the 
scene from. 

A shared virtual environment is usually implemented 
using a computer network wherein remote users operate 

20 clients in the network which incorporates servers for the 
virtual environment . 

For simple virtual environments, where the number 
of entities is limited, implementing a shared version is 
comparatively straightforward. As each user joins the 

25 virtual environment a client is provided with the current 
state of all entities within it. As the environment 
state changes, due to either user invoked behaviour or 
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autonomous behaviour, the newly generated state 
information is distributed to all clients, allowing a 
common view between different clients to be maintained. 
However, for larger virtual environments, where both 
5 the number of simultaneous users and entities is large, 
this approach breaks down. This is because the amount 
of information required to supply and support a total 
description of state at each client overwhelms either the 
network connection of the client or the processing power 

10 available to the client. - 

One common solution to this problem is to utilise 
the fact that a client does not need to maintain a valid 
state description of any entities its user is unaware of. 
For example, if two avatars are playing tennis, it is 

15 important that both their clients are kept fully informed 
of the position of the ball. However, for the users who 
can't see or hear the tennis court it is not necessary 
to inform them of either the ball state or the state of 
the avatars playing tennis. Only when they move into a 

20 position where the court can be observed is this 
•information required . 

A common implementation of this solution sub-divides 
the . environment into a number of regions, termed zones 
and then groups the entities on the basis of the zone 

25 they occupy. Each users avatar location is then used to 
assess what zones the user is aware of, and the client 
is informed of the state of all entities within these 



m 
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zones. As entities update their state they broadcast the 
change only to the clients aware of their current zone. 
In this way the network and processing load on each 
client is proportional to the state changes in their 
5 avatars surrounding location, rather than the total 
environment . 

An example of an implementation of this type of this 
approach is NPSNET (Macedonia et ai "NPSNET: A Network 
Software Architecture for Large Scale Virtual 

10 Environments*', Presence, Volume 3, No. 4, Fall 1994 ) the 
content of which is hereby incorporated by reference. 
In this implementation the virtual environment is divided 
into a number of hexagonal zones and a multicast address 
is associated with each zone. Each client maintains a 

15 network connection to the multicast address of the zone 
its avatar is in. This address is used by the client to 
broadcast any avatar state change e.g. movement. 
Additionally the client also maintains network 
connections to the multicast address of any zones the 

20 user is aware of i.e. within visual or aural range. 
Hence two clients with neighbouring avatars will share 
avatar state updates by virtue of using common multicast 
addresses. However, two users widely separated within 
the virtual environment will not share awareness of any 

25 zones and hence will not load each others network 
connection with shared state information. 
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Figure 1 is an illustration of this zonal 
distributed virtual environment. As can be seen in Figure 
1 an avatar has a range of awareness which comprises a 
volume which is often spherical and is centred on an 
5 avatar. This range of awareness encloses all the 
entities that a client needs to possess the state of in 
order to accurately display the world to the user. The 
volume is often defined with respect to the visual range 
of any rendering performed at the client although it may 

10 be derived from the range of any of the relevant senses 
e.g. hearing. 

In Figure 1 the illustrated area of the virtual 
environment is divided into nine geographic areas or 
zones each of which has a multicast address associated 

15 with it. Client A has an avatar A in zone 3 and has a 
range of awareness which spans into zones 2 and 6. Thus, 
client A monitors zones 2, 3 and 6. Since the avatar A 
can modify the state of entities in zone 3, and since the 
avatar state changes, updates are made using the 

20 multicast address for zone 3, Avatar B has a visual 
range which encompasses zone 3 and client B therefore 
listens to zone 3's multicast address as well as zone 2's 
multicast address in which the avatar B is present. 
Therefore, any changes to avatar A will be detected by 

25 client B and similarly any changes to avatar B will be 
detected by client A. in contrast, avatar C has no 
visual awareness of zones 2 or 3 and therefore client C 
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does not listen to their multicast addresses. This 
reduces the network load. 

Figure 2 is a schematic diagram of a network hosting 
the virtual environment schematically illustrated in 
Figure 1. Nine servers (1-9) are illustrated 

interconnected by a communications network 10 such as a 
local area network (LAN) or a wide area network (WAN). 
Each server is responsible for a respective geographical 
zone in the virtual environment and receives and 
transmits the status of the zone using a unique multicast 
address assigned for the zone. Also connected to the 
communications network 10 are three clients, client A 
(11), client B (12) and client C (13). Each client hosts 
an avatar and thus maintains the virtual environment 
experienced by the avatar. As described above each 
client will connect to a multicast address i.e. to a 
server dependent upon the zones of which an avatar is 
aware. A client can either comprise a workstation or an 
application i.e. a computer program running on a 
computer. Thus a single computer may host more than one 
client. Similarly a server can either comprise a 
dedicated computer or an application i.e. a computer 
program running on a computer. Thus a single computer 
may host more than one server. 

In an alternative arrangement disclosed in our 
copending Application No. GB 9722343.2 filed on 
22 October 1997, the content of which is hereby 
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incorporated by reference, zone managers are responsible 
for managing each zone within the virtual environment and 
thus the location of the avatar within the virtual 
environment and the awareness range of the avatar will 
determine the communications required between the client 
and the zone managers . 

In this arrangement objects in the virtual 
environment have a conceptual models a dynamics model and 
a visual model. A rule manager is associated with the 
conceptual model. The visual model is provided at each 
client and the dynamic model is associated with the zone 
managers. Thus only dynamics information needs to be 
passed between the zone managers and the clients. 

A problem identified by the inventors in a zoned 
distributed environment is how to link avatar movement 
to zone awareness. Figure 3 illustrates this problem. 
Avatar A is in zone 1 and moving towards the boundary 
between zone 1 and zone 2. Client A is therefore aware 
of the state of the entities within zone 1 (entities 1 
and 2) but is unaware of the state of any of the entities 
within zone 2 (entities 3 and 4). In some point in the 
future, avatars A awareness will overlap into zone 2 and 
client A must become fully informed of the state of all 
entities in zone 2 (entities 3 and 4), 

If client A only starts to fetch the initial state 
of the entities in zone 2 at the point avatar A becomes 
initially aware of zone 2 i.e. the awareness region 
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touches the boundary between zones 1 and 2, a number of 
problems can arise: 

1. Graphical inconsistency. While the initial 
state of the zone is being fetched the avatar may 
5 continue moving towards it. Hence the avatar may be in 
the visual range of entities which have not yet been 
supplied. When the initial state download is complete 
these entities will suddenly appear, giving a visual 
glitch , 

10 2. User control problems. If the avatar is 

prevented from moving whilst fetching the state of a zone 
(in an effort to prevent the graphical inconsistency 
described above), it will reduce the interactive nature 
of the client user interface. 

15 3. State Inconsistency. If the avatar is moving 

fast enough it may even cross into the next zone before 
its client has a full description of all the relevant 
entities. This could lead to the client trying to make 
invalid state settings. For example, placing the avatar 

20 in the middle of a wall because at the time the avatar 
moved the client was unaware of the wall entity. 

In order to overcome this problem, one aspect of the 
present invention provides a method and apparatus for 
predicting the likelihood of an avatar under the control 

25 of a user in a virtual environment moving within a 
predetermined range of a boundary, wherein the movement 
of the avatar in the virtual environment is monitored for 
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a period of time, the model of the avatar movement is 
determined using the monitored movement, and the 
likelihood of the avatar moving within the predetermined 
range of a boundary is predicted using the model. 
5 Thus, by monitoring movement of the avatar in the 

virtual environment for a period of time the pattern of 
movement can be determined which enables a model to be 
built. This can then be used to predict avatar movement. 
The accuracy of the model is important in order to avoid 

10 unnecessary downloading of state information. If the 
current velocity in a direction is simply extrapolated 
from the current position for a time, a simple prediction 
can be made. However, such a simple prediction fails to 
take into account a number of factors that directly 

15 affect the probability of an avatar coming within the 
range of a boundary. A highly experienced user, who knows 
the environment well, will be able to plan paths in 
advance and move quickly between known land marks. This 
will result in long, predictable avatar tra jectories - 

20 By contrast an inexperienced user will need to stop 
frequently to reaffirm their position, and will not be 
able to use known land marks to plan an avatar path. 
This will reduce the predictability of their avatar. 
Also, environments such as games and military 

25 stimulations where avatar paths are a key part of the 
user interaction, will result in more predictable avatar 
trajectories than those where navigation does not play 
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a key role. For example, a large open room used as a 
chat space will result in fairly static avatars (whilst 
chatting in groups), with occasional short paths to 
random parts of the room (when a user spots somebody they 
want to talk to). By contrast, a game (e.g. Doom or 
Quake) where the typical goals are "travel to this door", 
"traverse this door", "find this key", etc will have far 
more mobile avatars, moving to specific points, and hence 
producing more predictable paths. Further, the mechanism 
for controlling an avatar normally has to map the output 
of the numerous different devices (keyboard, mouse, 
joystick, tracker ball, etc) into the six degrees of 
freedom available to an avatar (rotation and translation 
in three dimensional space) . The device and map being 
used will impact on the trajectory taken by the avatar. 
For example, using a mouse output mapped directly to an 
avatar's horizontal motion will result in bursts of short 
jerky motions. By contrast a keyboard input by its 
digital nature will tend to produce paths of more 
consistent motion. 

By utilizing a model of avatar movement, these 
factors can be taken into account to provide a more 
accurate prediction of the likely behaviour of an avatar 
based on its past behaviour. 

In a virtual environment in accordance with one 
aspect of the present invention each client utilises an 
avatar motion predictor which monitors avatar motion in 



• 
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a recent period of time to establish a pattern of avatar 
behaviour in order to predict the likelihood of an avatar 
becoming aware of a neighbouring zone. 

In order to determine the model of avatar behaviour, 
movement samples e.g. position, orientation, or velocity 
can be obtained for a set number of previous avatar 
movement samples. As new avatar movement information is 
supplied the model is continuously updated discarding the 
effect of older movement samples, thus ensuring that the 
model is of the avatar's current style of movement. 

The prediction technique can take into consideration 
features within the virtual environment which restrict 
movement of the avatar e.g. a window through which the 
avatar cannot move but through which the avatar can see 
into a neighbouring zone. In such a case although the 
avatar can see into the neighbouring zone, it cannot move 
into the zone in that direction and must instead take a 
different path. Thus environmental features will effect 
the predicted likelihood for example by reducing the 
predicted likelihood when a wall lies between the avatar 
and the boundary. 

Prediction can also be performed taking into 
consideration features within the virtual environment 
which restrict the ability of the avatar to experience 
the virtual environment e.g. fog or a darkened room. 
Thus although the avatars awareness zone extends over a 
boundary into a neighbouring zone, because of the 
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conditions, the awareness range of the avatar is reduced 
and thus there is no need to fetch the information on the 
neighbouring zone since it cannot be experienced by the 
avatar . 

The model can be determined as values for run 
lengths indicating the likelihood of an avatar moving in 
a direction for a particular length. Alternatively, the 
model can be determined as run lengths within a corridor 
indicating the likelihood of the avatar moving within a 
corridor in a direction for a particular corridor length. 
A corridor comprises a region in the virtual space 
coaxial with an initial direction of movement in a new 
direction outside a previous corridor. The width of the 
corridor defining the deviation allowed from the initial 
direction of movement before the movement is used to 
start a new run length. 

In another embodiment the model comprises values for 
areas around the avatar indicating the likelihood of the 
avatar moving into the areas . In a further embodiment the 
model comprises values for directions and distances of 
movement of the avatar for periods of time. 

Using the probability of an avatar moving within an 
awareness range of a neighbouring zone, together with 
known network and processing penalties of establishing 
zone awareness, the client can determine the time at 
which awareness of the zone should be attained i.e. when 
information on the state of entities within the zone 



wo 00/10130 



PCT/GB99/02663 



13 

should be retrieved over the network. If the penalty for 
fetching the state of the entities in a particular zone 
is very high on the client network link, the client may 
decide to wait until the avatar prediction model 
5 forecasts a 90% chance of awareness of that zone in the 
next second, alternatively, if the penalty is low it 
might decide to play safe and fetch the state of the zone 
when the model only predicts a 20% chance in the next two 
seconds . 

10 Thus in accordance with one embodiment of the 

present invention a more efficient distributed virtual 
environment is provided by using the prediction together 
with a cost function related to the client network 
connection and/or client processing capability or load 

15 in order to determine when to establish awareness of a 
neighbouring zone . 

Since the present invention can be implemented in 
software running on a computer or over a network, the 
present invention can be embodied as a storage medium 

20 storing instructions for controlling a computer to carry 
out the method and a signal carrying computer code for 
controlling a computer to carry out the method. 

The present invention will now be described by way 
25 of example with reference to the accompanying drawings, 
in which: 
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Figure 1 is a schematic diagram of the NPSNET 
multicast arrangement ; 

Figure 2 is a schematic diagram of a network hosting 
the virtual environment schematically illustrated in 
5 Figure 1; 

Figure 3 is a schematic diagram of an avatar 
approaching a zone boundary; 

Figure 4 is a schematic illustration of a network 
hosting the virtual environment incorporating the 
10 prediction technique of an embodiment of the present 
invention ; 

Figure 5 is a schematic diagram of an embodiment of 
the present invention; 

Figure 6 is a diagram illustrating the termination 
15 of the intersection boundary from the zone boundary; 

Figure 7 is a schematic diagram of point to point 
avatar motion; 

Figure 8 is a flow diagram illustrating the 
determination of the model using run lengths; 
20 Figure 9 is a flow diagram illustrating the method 

of using the model in order to determine when a client 
should become aware of the neighbouring zone; 

Figure 10 is a diagram of avatar movement within 
corridors ; 

25 Figure 11 is a flow diagram of the determination of 

the model from the motion of Figure 10; 
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Figures 12a to 12d illustrate a method of forming 
the model of avatar movement over an area; 

Figure 13a is a flow diagram of a first method of 
determining a model using the technique of Figure 12; 
5 Figure 13b is a flow diagram of a second method of 

determining a model using the technique of Figure 12; 

Figure 14 is a method of using the model to 
determine avatar awareness of a neighbouring zone using 
the method of Figure 12; 
10 Figures 15a and 15b illustrate the model using angle 

and distance; 

Figures 16a to 16e illustrate a method of 
determining the model of Figures 15a and 15b; 

Figure 17 is a flow diagram of the method of Figures 
15 14a to 14e; and 

Figure 18 is a flow diagram illustrating the method 
of using the model in order to determine avatar awareness 
of a neighbouring zone. 



20 Figure 4 is a schematic illustration of a network 

in accordance with an embodiment of the present 
invention. The network comprises servers 21 and 22 
interconnected over a communications network 2 5 to 
clients 23 and 24. The network is thus similar to Figure 

25 2 except a motion predictor 26 or 27 can be provided in 
the client 23 or the server 21 respectively (although the 
figure illustrates both only one will be provided in 
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practice). The clients 23 and 24 and the servers 21 and 
22 can be implemented as a computer program running on 
a host computer thus allowing multiple clients and 
servers on a single computer. The motion predictor 26 
5 or 2 7 can be implemented as a computer program on a 
computer hosting a client or a server. The location is 
not important so long as access to information on avatar 
movement and the virtual environment is available. The 
communications network 25 can be any form of network such 
10 as a LAN or a WAN. 

Figure 5 illustrates one embodiment of the present 
invention schematically wherein a virtual environment 
application 30 is hosted on a virtual environment client 

31 controlling avatar movement from which is available 
15 the current avatar movement and environment information. 

Avatar movements for previous time periods are also 
output and a sliding window of samples (termed the model 
time frame hereinafter) is used by the motion predictor 

32 to build a model of avatar motion. The environment 
20 information is used to determine the proximity of the 

zone boundary to the avatar. Within the virtual 
environment application 30 the motion predictor 32 
predicts the likelihood of an avatar coming within a 
predetermined range of the boundary of the zone. This 
25 prediction is used by a virtual environment client 31 in 
order to determine when to fetch the state information 
for a neighbouring zone. 



wo 00/10130 



PCT/GB99/02663 



17 



As mentioned above, the motion predictor 31 need not 
necessarily be placed on the same computer as the virtual 
environment client 31. if the responsibility for 
establishing client awareness of a zone is moved to a 
server e.g. the same server that delivers the zone state 
information, the motion predictor 31 can be placed on the 
server . 

Since the motion predictor continually builds its 
model of avatar motion using new avatar movement samples 
as they are supplied by the client, it will dynamically 
adapt to new types of motion. For example, if the user 
redefines the application interface in a way that gives 
less predictable avatar motion, as new avatar movements 
samples are fed into the prediction model this new 
uncertainty will be reflected in the output of the motion 
predictor. This will again enable the client to modify 
its policy for establishing its awareness of new zones. 

In normal operation the client will want an 
assessment of the avatars awareness crossing into a zone. 
This is equivalent to detecting whether an avatar is 
within an awareness range of the zone boundary. It is 
thus possible to determine an intersection boundary which 
is provided at the avatars awareness ranged from the zone 
boundary as illustrated in Figure 6. Thus instead of 
predicting whether the awareness zone will cross the zone 
boundary, it can equivalently be predicted whether the 
avatar will cross the intersection boundary. This 



wo 00/10130 



PCT/GB99/02663 



18 

technique of predicting the coincidence of the avatar 
position with the intersection boundary rather than 
predicting coincidence of the avatars awareness range d 
with the zone boundary simplifies the computation. 
5 In Figure 6 at an area marked "e" a small error 

occurs where the intersection boundary should in fact be 
rounded to ensure that it always lies at a distance d 
from the zone boundary. This error can however, be 
assumed to be negligible. 

10 In the embodiments described hereinafter the 

prediction is thus a prediction of whether the avatar 
will cross the intersection boundary as illustrated in 
Figure 6 . In all of the following embodiments the 
position of the avatar is monitored at movement sample 

15 periods and the samples are used to populate each model. 
A window of samples, termed a model time frame, are used 
to form each model and the size of the set of samples and 
the frequency of its update is implementation dependent. 
When selecting the size of the set the implementation 

20 should ensure: 

1. The set is large enough to reflect the general 
style of avatar motion, and not temporary types of motion 
caused by the local environment. For example, an avatar 
walking down a spiral staircase will be forced to adopt 

25 a curved path. A very small sample set in this scenario 
would cause the prediction model to reflect avatar motion 



# 
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as regularly changing direction, when this may not be 
indicative of the more unconstrained motion. 

2. The set is small enough to allow the prediction 
model to adapt to new types of motion within a reasonable 
5 time frame. If the set is too large it may reflect 
multiple styles of avatar motion simultaneously which 
will seriously impair the accuracy of the predictions. 

A first embodiment of the present invention will now 
be described with reference to Figures 7 to 9 . 

10 Figure 7 illustrates avatar movement from sample 

point to sample point and treats the avatar movement as 
a series of straight runs each run comprising two or more 
sample points. In this embodiment the prediction model 
consists of a table of run lengths against a probability 

15 of occurrence. Such a table is illustrated below: 



Run lenath 
(m) 


Number of 
occurrences 


Likelihood 


0.0 - 1.0 


1000 


1 . 0 


1.0 - 2.0 


870 


0 .87 


2.0 - 3.0 


700 


0.7 


3.0 - 4.0 


500 


0 . 5 


4.0 - 5.0 


300 


0 . 3 


5.0 - 6.0 


100 


0 . 1 


6.0 - 7.0 


10 


0.01 


>7.0 


0 


0 



Figure 7 illustrates five runs in a model time frame 
of 30 samples. Each run length from sample 1 to 7 , 7 to 



wo 00/10130 PCT/GB99/02663 



20 

11, 11 to 19, 19 to 21 and 21 to 30 is termed a 
prediction time frame and thus each model time frame 
consists of a variable number of variable length 
prediction time frames. When the direction of movement 
is detected as changing, a new prediction time frame (run 
length) is started. 

In the table above the model time frame comprises 
1001 samples (the first sample acting as a reference 
point). Occurrences are incremented not for a final run 
length but for each run length up to the final run length 
e.g. a total run length of 2.3 metres will result in an 
occurrence in each of the first three rows i.e. 0.0-1.0, 
1,0-2,0 and 2.0-3.0, All run lengths have a length of 
at least between 0 and 1 metres. The number of run 
lengths having progressively longer run lengths decreases 
and no run lengths are longer than 7 metres. The table 
also includes a likelihood value which is calculated from 
the number of occurrences for a run length divided by the 
total number of occurrences i.e. the model time frame 
length minus 1. This is calculated each time the table 
entries are changed to keep the table up-to-date. The 
table is used by using the distance the avatar is away 
from the intersection boundary as an input to match to 
a run length to output the likelihood e.g. if the 
distance is 1.8 metres there is an 87% chance that the 
avatar will cross the boundary in this run, but if the 
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distance is 8 metres there is no chance that the avatar 
will cross the boundary in this run. 

Figure 8 is a flow diagram illustrating how the 
table of run lengths and likelihoods comprising the model 
5 is formed. 

In step SI initially the first two samples are 
entered and a sample counter n is set to equal 2. In 
step 32 the current run length is determined and in step 
S3 the entry in the table for the current run length is 

10 incremented. The likelihood values in the table are then 
updated in step S4 and the next sample point is awaited 
in step S5. When the next sample point is received, in 
step S6 the length of the current sample in the model 
time frame is incremented i.e. n is set equal to n + 1 

15 and in step S7 it is determined whether the number of 
current sample points in the model time frame is equal 
to the maximum number of sample points N. If not, in 
step S8 it is determined whether there has been a change 
in direction and if not the process returns to step S2 

20 wherein the current run length is determined. If a 
change in direction has been determined in step SB, in 
step S9 the run length is restarted from the previous 
sample point and the process returns to step S2 . 

If in step 87 it is determined that the model time 

25 frame is full, in step SIO the first sample point in the 
model time frame is incremented to the first sample point 
in the second prediction time frame in the model time 
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frame i.e. to the second run length in the prediction 
time frame. The table entries corresponding to the first 
prediction time frame in the model time frame are then 
removed in step Sll so that the effect of the first time 
5 frame is removed from the model. In this way the model 
is kept up-to-date only taking into consideration the 
most recent run lengths . 

Having deleted the oldest prediction time frame (run 
length) in step Sll the process then proceeds to step S8 

10 to determine whether there has been a change in direction 
brought about by the new sample point. If there has been 
no change in direction the run length is determined in 
step S2 but if there has been a change in direction in 
step S9 the run length is restarted from the previous 

15 sample point and then the run length is determined in 
step S2 . 

Figure 9 is a flow diagram illustrating how the 
model is used. In step S12 the distance to the zone 
boundary is input and in step S13 this is used to look-up 

20 the likelihood for a corresponding run length. Thus a 
likelihood of the avatar moving within a predetermined 
range of the boundary is determined. In step S14 this 
can be compared with a threshold to determine whether or 
not to reguest information on the status of the zone 

25 beyond the boundary in step S15. The threshold 
percentage used in step S14 can be predetermined 
independently to the implementation environment or it can 
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be set in dependence upon the operating conditions e.g. 
the current network loading, the network loading required 
to obtain the status information, the current processing 
load, and the expected processing load for downloading 
5 the status information. 

A second embodiment of the present invention will 
now be described with reference to Figures 10 and 11. 

This embodiment of the present invention is similar 
to the first embodiment except that instead of measuring 

10 a run length as being from "point to point", a run length 
is calculated along a corridor. This allows for some 
deviation in the path before it is considered that the 
avatar has changed direction. Figure 10 illustrates the 
use of corridors to define run lengths. 

15 Figure 11 is a flow diagram illustrating the 

operation of this embodiment. In step S16 the first two 
samples are input in the model time frame and the sample 
counter is set to equal 2. In step S17 the current run 
length within a corridor is determined and in step S18 

20 the entry in the table for the current run length is 
incremented. In step S19 the likelihood values in the 
table are updated and in step S20 the next sample point 
is awaited. When the next sample point is received in 
step S21 the length of the current samples in the model 

25 time frame are incremented such that n is set equal to 
n + 1. In step S22 it is then determined whether the 
number of current sample points in the model time frame 
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equals N i.e. is the model time frame full, and if not 
the process proceeds to step S23 wherein it is determined 
whether there is a change in direction. If not, the 
process returns to step S17 whereupon the current run 
5 length within a corridor is determined. If a change of 
direction is determined in step S23, in step S24 the run 
length is restarted from the previous sample and the 
process returns to step S17. 

If in step S22 it is determined that the model time 

10 frame is full, the first sample point in the model time 
frame is incremented to the first sample point in the 
second prediction time frame in the model time frame and 
in step S26 corresponding table entries for the first 
prediction time frame (the first run length) are removed. 

15 The process then proceeds to step S23. 

This embodiment can be considered to be a more 
relaxed version of the embodiment illustrated with 
reference to Figures 7 and 8 since the run length 
embodiment illustrated in Figures 7 and 8 can be 

20 considered to have a corridor of 0 width, 

A third embodiment of the present invention will now 
be described with reference to Figures 12 to 14. 

This approach attempts to map avatar motion into a 
probability area of occupation. As can be seen in Figure 

25 12a the avatar motion can be seen as a number of paths 
between points and this is broken up in the method to a 
series of segments 1 to 7 . 
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Each of the segments comprises a prediction time 
frame. As illustrated in Figure 10a the model time frame 
thus comprises seven prediction time frames in this 
embodiment . 

Referring to the flow diagram of Figure 13a which 
illustrates a first method, in step S30 the first sample 
point of a prediction time frame is used as the origin 
of the model and thus the prediction time frame is 
relatively aligned with the origin of the model. In step 
S31 the prediction time frame is relatively aligned with 
the model using the path to the reference sample point 
as illustrated in Figure 10b. The reference sample point 
comprises a first sample point in a segment and thus a 
first sample point in the prediction time frame. The 
path to the reference sample point is illustrated as "u" 
in Figure 10b. In step S32 the next sample point is then 
received and the sample point counter n is incremented. 
In step S33 it is then determined whether the number of 
sample points n is equal to N i.e. the model prediction 
time frame is full. If not in step S34 the avatar path 
to the next sample point is defined and in step S35 for 
areas through which the avatar path passes within a 
predetermined area i.e. within the circle of Figures 10b, 
10c and lOd, table entries are incremented. In step S36 
it is then determined whether the next sample point is 
outside the predetermined area i.e. whether it is the 
first point in a next prediction time frame. If not the 
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process returns to step S32 to receive the next sample 
point. If the next sample point is outside the area in 
step S37 the sample point is made the reference sample 
point and the process returns to step S30 whereupon the 
5 reference sample point is aligned with the origin of the 
model . 

If in step S33 it is determined that the model time 
frame is full and another sample point has been received, 
in step S38 the first sample point in the model time 

10 frame is incremented to the first sample point in the 
second prediction time frame i.e. to a first sample point 
of the second segment. Then in step S39 the table 
entries for the first prediction time frame in the model 
are removed and the process proceeds to step S36 . In 

15 this way the model time frame becomes a sliding time 
frame so that the model only takes into account recent 
behaviour of the avatar. 

In the flow diagram of Figure 13a the model time 
frame is moved along one prediction time frame at a time. 

20 Thus, the model time frame moves coarsely in jumps. In 
an alternative embodiment the model time frame is moved 
along point by point wherein the last prediction time 
frame of samples in a model is used each time to 
increment table entries. 

25 This method is illustrated in Figure 13b. In step 

S300 the last prediction frame of samples in a model time 
frame of samples is selected and in step S310 the origin 
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of the model is relatively aligned with a reference 
sample point as can be seen in Figure 12b. The reference 
sample point comprises a first sample point in a segment. 
In step S320 the prediction time frame is relatively 
5 aligned with the model using the path to the first 
reference sample point. This is illustrated as "u" in 
Figure 12b. The avatar path to the next sample point is 
then defined in step S330 and in step S340 for areas 
through which the avatar path passes within a 

10 predetermined area (i.e. within the circle of Figures 
12b, 12c, and 12d) table entries are incremented. 

In step S350 it is determined whether the end of the 
prediction frame has been reached and if not in step S360 
it is determined whether the sample point lies outside 

15 the predetermined area i.e. the circle in Figures 12b to 
12d. If not, the process returns to step S330 to find 
the next avatar path in the segment. If the sample point 
is outside the circle in step S350 the sample point is 
redefined as the reference sample point in step S370 and 

20 the process then returns to step S32 wherein the next 
segment is time aligned with the model. 

It can thus be seen that steps S320 to S370 are 
repeated until all of the paths, of the segments 1 to 7 
have been mapped into the model to accumulate counts for 

25 the areas shown as squares Figure 12c through which the 
paths pass. The counts accumulated in the table for each 
of the areas are indicated in Figures 12c and 12d by 
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shading where the darker shading illustrates a higher 
count . 

If in step S350 the end of the prediction time frame 
has been reached, the first sample point in the model 
5 time frame is incremented in step S380 and the table 
entries for the oldest sample in the model time frame are 
removed in step S390. The process then returns to step 
S300 to repeat for the next prediction frame. 

In order to utilise the model to predict the 
10 likelihood of an avatar crossing the intersection 
boundary, as illustrated in Figure 14 in step S40 the 
boundary position and angle is input and in step S41 the 
boundary is overlaid on the model as illustrated in 
Figure 12d. The counts for the zones crossed by the 
15 boundary are then added up in step S4 2 and in step S43 
the counts are calculated as a percentage of the total 
number of counts in the model. The likelihood generated 
in step S43 is then compared with a threshold in step S44 
and if the threshold is exceeded in step S45 the client 
20 will request information on the status of the zone beyond 
the boundary . 

A fourth embodiment of the present invention will 
now be described with reference to Figures 15 to 18, 

In this embodiment successive periods of avatar 
25 motion (sample sequences from the sample subset) are 
analysed against a series of potential zone boundaries 
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to build a probability of boundary crossing model. This 
model is expressed as a table with three dimensions: 

1. Angle between avatar direction of motion and 
zone boundary line, 
5 2. Distance between avatar position and zone 

boundary line, 

3, Time. 

The granularity of this table is determined by the 
processing power available to the predictor. For a very 

10 fine grained table, each sequence of samples in the 
sample subset is compared against a large number of 
potential boundaries, over a wide range of times, and the 
table populated with the results. The coarser of the 
table granulator the fewer the boundary comparisons and 

15 less representation is required. 

For example, if the model uses a granularity of 
30 degrees and forward distance steps to approximate 
relative zone boundaries, 48 boundary representations 
will be produced. This is illustrated in Figure 15a. 

20 Note that the zone boundaries are considered to extend 
to infinity in both directions such as shown in Figure 
15b for a set of boundaries at a particular distances, 
A method of this embodiment of the present invention 
will now be described with reference to Figures 16 and 

25 17. 

The last prediction frame of samples in the model 
time frame of samples is selected in step S50. This is 
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assuming that this has been carried out iteratively 
throughout the model time frame for prediction frames 
starting at each sample point that finishes outside the 
outer boundary segment of the model as for the previous 
5 embodiment. The origin of the model is relatively 
aligned with a reference sample point which comprises the 
first sample point in the prediction frame (step S51). 
In step S52 the prediction time frame is relatively 
aligned with the model using the path to the reference 

10 sample point. The results of steps S51 and S52 can be 
seen in Figure 16a. 

In step S53 the avatar path to the next sample point 
is defined as shown in Figure 16b and in step S54 any 
table entries for boundaries across which the avatar path 

15 passes are incremented. in Figure 16b no boundaries are 
crossed and thus no table entries are incremented. In 
step S55 it is then determined whether the prediction 
time frame has been processed i.e. whether the last 
sample point is outside the outer boundary, and if not 

20 the process returns to step S53. As can be seen in 
Figure 16c the path to the next sample point is defined 
and this crosses eight of the theoretical boundaries 
which are incremented. Since each sample point 

corresponds to a time period these entries are made 

25 corresponding to that particular time period. For 
example, if the sample rate is 10 hertz the entries at 
0.2 of a second would be incremented in the table. 
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Figure 16d illustrates the next loop through steps 
S53 to S55 wherein table entries for 0.3 of a second are 
implemented for the 11 boundary segments crossed. 

Figure 16e illustrates the path from the fourth to 
5 fifth sample at 0.4 seconds and the 14 boundary segments 
crossed . 

It should be noted that the determination of the 
boundary segments crossed is not made in dependence upon 
the path to each point it is made in dependence upon the 
10 path from the origin to the sample point* Hence the 
number of boundary segments crossed increases for each 
sample point in the prediction time frame. 

Each boundary segment corresponds to entry of the 
table indexed by angle and distance and since the samples 
15 are input with respect to time, at each sample time, a 
different set of entries are made. 

In step S56 at the end of the prediction time frame 
the number of counts in the prediction time frame is 
added to the running total for the model time frame i.e. 
20 the entries for the three dimensional table for the most 
recent prediction time frame is added into the three 
dimensional table for the previous prediction time frames 
of the model time frames. 

The process then awaits the next sample in step S57 
25 and when the next sample is received in step S5 8 the 
first sample point in the model time frame is incremented 
and in step S59 the table entries for the oldest sample 
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in the model time frame are removed in order to update 
the table. The process then returns to step S50 so that 
the prediction time can be moved along one sample point 
within the model time frame. 
5 Figure 18 is a flow diagram illustrating how the 

table is used. In step S60 the distance angle and time 
to the zone boundary are input and used in step S61 as 
three coordinates to look-up the number of counts in the 
table. The looked-up counts are then calculated as a 

10 percentage of the total number of counts in the table in 
step S62 in order to return a likelihood of the avatar 
crossing the intersection boundary. In step S63 it is 
then determined whether the percentage is above the 
threshold and if so, in step S64 the client requests 

15 information on the status of the zone beyond the 
boundary . 

As for the pervious embodiments, the threshold in 
step S6 3 can be predetermined and can be dependent on a 
cost function such as network and processing penalties 
20 of establishing zone awareness. 

Although in all the above embodiments the likelihood 
is shown as being obtained directly from the table 
(model) this likelihood can be modified to take into 
account the virtual environment between the avatar and 
25 the boundary e.g. if a wall is between the avatar and the 
boundary the likelihood can be reduced accordingly. Thus 
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the predictor can not only take into account avatar 
movement but also the local environment. 

By determining the likelihood of the avatar 
awareness region crossing into a zone it is possible to 
5 determine when and if to download the state of a zone of 
which the client is not currently aware. Since the 
downloading of the state of a zone imposed by the network 
and processing load of the client, the use of the model 
to provide an accurate prediction reduces the likelihood 

10 of unnecessarily downloading the state information. Also, 
once in a current state of a zone has been fetched it is 
necessary to track all the state changes that occur 
within it to ensure that the state stays current. 
Therefore, the accurate prediction produces the 

15 unnecessary traffic and processing load associated with 
an unnecessary download and updating. 

In accordance with the embodiment of the present 
invention by taking into consideration the known network 
and processing penalties of establishing zone awareness, 

20 it is also possible for the client to control and tune 
the downloading of state information in order to suit the 
current state of the hardware implementing the virtual 
environment . 

The present invention can be implemented in any type 
25 of zonal distributed virtual environment such as the 
NSPNET system and the system described in copending 
application number GB 9722343,2. 
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Although the present invention has been described 
hereinabove with reference to specific embodiments, it 
is apparent to a skilled person in the art that 
modifications are possible within the spirit and scope 
5 of the present invention. 



wo 00/10130 



PCT/GB99/02663 



35 

CLAIMS : 

1. Apparatus for predicting the likelihood of an avatar 
under the control of a user in a virtual environment 
5 moving within a predetermined range of a boundary, the 
apparatus comprising : 

monitoring means for monitoring movement of said 
avatar in said virtual environment for a period of time 
so as to obtain movement data; 
10 model means for determining a model of avatar 

movement using the movement data; and 

prediction means for predicting the likelihood of 
said avatar moving within said predetermined range of 
said boundary using said model. 

15 

2 . Apparatus according to claim 1 wherein said model 
means is adapted to determine a dynamic model using only 
movement monitored within a recent time period. 



20 3. Apparatus according 
said monitoring means is 
of said avatar with time 



to claim 1 or claim 2 wherein 
adapted to monitor the position 
in said virtual environment. 



4- Apparatus according to any preceding claim wherein 
25 said prediction means is adapted to perform said 
prediction taking into consideration features within said 
virtual environment which restrict movement of said 
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avatar . 

5. Apparatus according to any preceding claim wherein 
said prediction means is adapted to perform said 
5 prediction taking into consideration features within said 
virtual environment which restrict the ability of said 
avatar to experience the virtual environment, 

5- Apparatus according to any preceding claim wherein 
10 said predetermined range is dependent upon a range of 
awareness of said avatar within which said avatar can 
experience the virtual environment, and said prediction 
means is adapted to perform said prediction taking into 
consideration features within said virtual environment 
15 which restrict the range of awareness of said avatar. 

7. Apparatus according to any preceding claim wherein 
said prediction means is adapted to predict a likelihood 
of said avatar moving within said predetermined range of 

20 said boundary within a predetermined period of time. 

8. Apparatus according to any preceding claim wherein 
said monitoring means is adapted to provide time sampler 
of the position of said avatar, and said model means is 

25 adapted to determine a dynamic model which is updated 
every n^^ sample from said monitoring means using the n 
most recent samples, and which is. formed using a 
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plurality m of most recent sets of n samples from said 
monitoring means . 

9 . Apparatus according to any preceding claim wherein 
said model means is adapted to determine said model as 
set of values for directions and distances of movement 
of said avatar. 

10. Apparatus according to any one of claims 1 to 8 
wherein said model means is adapted to determine said 
model as values for areas around said avatar indicating 
the likelihood of said avatar moving into said areas. 

11. Apparatus according to any one of claims 1 to 8 
wherein said model means is adapted to determine said 
model as values for run lengths indicating the likelihood 
of said avatar moving in a direction for a particular 
length, 

12. Apparatus according to any one of claims 1 to 8 
wherein said model means is adapted to determine said 
model as values for run lengths within a corridor 
indicating the likelihood of said avatar moving within 
a corridor in a direction for a particular corridor 
length . 



A system for providing a distributed virtual 
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environment, the apparatus comprising: 

one or more servers for maintaining said virtual 
environment as a plurality of zones; 

a client for providing a user interface to the 
5 virtual environment to allow a user to control an avatar 
in the virtual environment, wherein said client is 
adapted to communicate with one or more of the servers 
only with regard to one or more zones in the proximity 
of said avatar; and 
10 apparatus for predicting the likelihood of said 

avatar moving within a predetermined range of a boundary 
of a zone according to any one of claims 1 to 12; 

wherein said client is adapted to communicate with 
one or more of the or each servers to obtain information 
15 on the status of one or more further zones when the 
likelihood of the avatar moving within a predetermined 
range of the boundary of said one or more further zones 
is above a threshold - 

20 14, A system according to claim 13 wherein said client 
is adapted to communicate with said one or more servers 
to obtain information on the status of one or more 
further zones when the likelihood of the avatar moving 
within a predetermine range of the boundary of said one 

25 or more further zones is above a threshold and in 
dependence upon at least one of the amount of 
communication traffic, the time taken for the 
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communication with the or each servers, and the 
processing power required as a result of the 
communication . 

15. A client for use with a computer system for 
providing a distributed virtual environment which 
includes one or more servers for maintaining said virtual 
environment as a plurality of zones, the apparatus 
comprising : 

interface means for providing a user interface to 
the virtual environment to allow a user to control an 
avatar in the virtual environment wherein the interface 
means is adapted to communication with one or more of the 
or each servers only with regard to a number of zones in 
the proximity of said avatar; and 

apparatus for predicting the likelihood of said 
avatar moving within a predetermined range of a boundary 
of a zone according to any one of claims 1 to 12; 

wherein the said interface means is adapted to 
communication with one or more of the or each servers 
to obtain information on the status of one or more 
further zones when the likelihood of the avatar moving 
within a predetermined range of the boundary of said one 
or more further a zones is above a threshold. 



16. A client according to claim 15 wherein said 
interface means is adapted to communication with said one 
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or more servers to obtain information on the status of 
one or more further zones when the likelihood of the 
avatar moving within a predetermine range of the boundary 
of said one or more further zones is above a threshold 
5 and in dependence upon at least one of the amount of 
communication traffic, the time taken for the 
communication with the or each servers, and the 
processing power required as a result of the 
communication . 

10 

17. A method of predicting the likelihood of an avatar 
under the control of a user in a virtual environment 
created by a computer system moving within a 
predetermined range of a boundary, the method comprising 

15 the following steps performed by said computer system: 
monitoring movement of said avatar in said virtual 
environment for a period of time; 

determining a model of avatar movement using the 
monitored movement; and 

20 predicting the likelihood of said avatar moving 

within said predetermined range of said boundary using 
said model . 



25 



18. A method according to claim 17 wherein said model 
is determined is a dynamic model using only movement 
monitored within a recent time period. 
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19. A method according to claim 17 or claim 18 wherein 
the movement of said avatar is monitored by monitoring 
the position of said avatar with time in said virtual 
environment . 

5 

20. A method 
wherein said 
consideration 
which restrict 

10 

21. A method according to any one of claims 17 to 20 
wherein said prediction is performed taking into 
consideration features within said virtual environment 
which restrict the ability of said avatar to experience 

15 the virtual environment. 

22. A method according to any one of claims 17 to 21 
wherein said predetermined range is dependent upon a 
range of awareness of said avatar within which said 

20 avatar can experience the virtual environment, and said 
prediction is performed taking into consideration 
features within said virtual environment which restrict 
the range of awareness . 

25 23. A method according to any one of claims 17 to 22 
wherein said prediction is a prediction of a likelihood 
of said avatar moving within said predetermined range of 
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prediction is preformed taking into 

features within said virtual environment 
movement of said avatar. 
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said boundary within a predetermined period of time. 

24, A method according to any one of claims 17 to 23 
wherein the monitoring provides time samples of the 

5 position of said avatar in said virtual environment, and 
said model is determined as a dynamic model which is 
updated every n^*' sample using the n most recent samples, 
and which is formed using a plurality m of most recent 
sets of n samples . 

10 

25. A method according to any one of claims 17 to 24 
wherein said model is determined as set of values for 
directions and distances of movement of said avatar. 

15 26. A method according to any one of claims 17 to 24 
wherein said model is determined as values for areas 
around said avatar indicating the likelihood of said 
avatar moving into said areas . 

20 27. A method according to any one of claims 17 to 24 
wherein said model is determined as values for run 
lengths indicating the likelihood of said avatar moving 
in a direction for a particular length. 

25 28. A method according to any one of claims 17 to 24 
wherein said model is determined as run lengths within 
a corridor indicating the likelihood of said avatar 
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moving within a corridor in a direction for a particular 
corridor length . 

29. A method of using a computer system to provide a 
5 distributed virtual environment, the method comprising 

the following steps performed by the computer system: 

maintaining said virtual environment as a plurality 
of zones using one or more servers; 

controlling a client to provide a user interface to 
10 the virtual environment to allow a user to control an 
avatar in the virtual environment, wherein said client 
communicates with one or more of the servers only with 
regard to one or more zones in the proximity of avatar; 

predicting the likelihood of said avatar moving 
15 within predetermined range of a boundary of a further 
zone using the method of any one of claims 17 to 28; 

wherein said client communicates with said one or 
more servers to obtain information on the status of said 
further zone when the likelihood of the avatar moving 
20 within a predetermined range of the boundary of said 
further zone is above a threshold. 

30. A method according to claim 29 wherein the 
communication with said one or more servers is further 

25 dependent upon a cost function associated with the 
potential degradation in performance experienced by a 
user . 
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31. A method according to claim 30 wherein the 
communication is further dependent upon at least one of 
the amount of communication traffic, the time taken for 
the communication with said servers, and the processing 
5 power required as a result of the communication. 

32 . A method of providing a client in the method of 
claim 29, the method comprising: 

providing a user interface to the virtual 
10 environment to allow a user to control an avatar in the 
virtual environment, wherein the user interface only 
communications with one or more of the servers with 
regard to a number of zones in the proximity of said 
avatar ; 

15 predicting the likelihood of said avatar moving 

within a predetermined range of a boundary of a further 
zone using the method of any one of claims 17 to 28, 

wherein the user interface communicates with said 
one or more servers to obtain information on the status 

20 of said further zone when the likelihood of the avatar 
moving within a predetermined range of the boundary of 
said further zone is above a threshold. 

33. A method according to claim 32 wherein the 
25 communication with said one or more servers is further 
dependent upon a cost function associated with the 
potential degradation in performance experienced by a 
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user . 

34. A method according to claim 33 wherein the 
communication is further dependent upon at least one of 

5 the amount of communication traffic, the time taken for 
the communication with said servers, and the processing 
power required as a result of the communication. 

35. A storage medium storing instructions for 
10 controlling a computer to carry out the method of any one 

of claims 17 to 34. 

36. A signal carrying computer implementable 
instructions for controlling a computer to carry out the 

15 method of any one of claims 17 to 34. 
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